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(57) Abstract: A method and system for discarding and regenerating transmission control protocol (TCP) acknowledgment packets 
(ACKs. transmitted over an asymmetrical digital subscriber line (ADSL) to increase the data transmission rate When an incomine 
ACK is received a. a first intermediate node located at one end of the ADSL link, the intermediate node determines whether a prior 
,rom ,hc same connection/flow (TCI> receiver) is presently stored in a queue awaiting transmission. If a prior ACK packet is 
not presently stored in the queue, the incoming ACK packet is stored in the queue. However, if there is a prior ACK packet in the 
queue, the information contained in the incoming ACK packet is stored in a per-connection slate table and the incomins ACK packet 
is discarded. When the prior ACK packet is ready to be transmitted to a second intermediate node via the ADSI link the information 
contained in the per-connection stale table regarding the discarded incoming ACK is copied into the prior ACK. Upon receiving- the 
prior ACK. the second intermediate node regenerates the discarded ACK based on the information contained in the prior ACK 
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•.METHOD AND SYSTEM FOR DISCARDING AND REGENERATING 
ACKNOWLEDGMENT PACKETS IN ADSL COMMUNICATIONS 

Field of the Invention 

The present invention relates to a method and system for transmitting data 
packets over an asymmetrical digital subscriber line. More particularly, the present 
invention relates to a method and system for discarding and regenerating transmission 
control protocol (TCP) acknowledgement packets transmitted over an asymmetrical 
digital subscriber line (ADSL) to increase the data transmission rate. 

Background of the Invention 

Digital subscriber line (DSL) technology was developed for use as a 
transmission medium for the Integrated Services Digital Network (ISDN) basic rate 
access channel. Asymmetric DSL (ADSL) offers a variety of Internet access speeds 
over a single twisted pair. Therefore, ADSL holds the highest potential in the DSL 
family to offer inexpensive, broadband access to homes and office in the near term. 
Presently, the primary application for ADSL in Internet traffic employing TCP. A 
very high percentage of Internet traffic is TCP because it is robust in wide variety of 
environments. 



ADSL provides significant increases in bandwidth over existing copper lines 
using the traditional duplex POTS channels, occupying the frequency band between 
300 Hz and 4KHz. ADSL provides a forward transmission channel of 1.5-8 Mbps, 
occupying the frequency band of 100KHz-500KHz, and a reverse transmission 
channel of 64-786 Kbps, occupying the frequency band of 1-KHz to 50KHz. ADSL 
has bandwidth asymmetry rather than latency asymmetry since the propagation delay 
is quite negligible. An ADSL line is for exclusive use of the subscriber, with no 
contention for bandwidth on the local loop. 

The asymmetric nature of ADSL adversely affects the performance of TCP 
because TCP throughput is regulated and limited by the flow of acknowledgments 
(referred to as the "ACK clock") generated by the receiver in response to received 
data packets. In particular, TCP steady data transmission is dependent upon 
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acknowledgment packets (ACKs) havfag ^ ^ ^ ^ ^ ^ ^ ^ ^ 
send.. Once tire ACKs the sender, the data packets are men clocked „„, ^ 
the same spacing. Wi «h ADSL, bandwidth asyromeny affects the perfoimance of 
TCP because i, relies o„ timely feedback from ^ recejw „ ^ ^ ^ 
5 and My utilize ft. avai,ab,e bandwidth in the fotwaro direction. Therefore a„ y 
disruption in the feedback process unpafrs ,he performance of.be forward direction 
da, transfer. Further, a ,ow bandwidth acknowiedgemen. pad, co„,d signiticantly 
siow the grow* of the TCP window a, the sender side, and make tire data 
transmission speeds independent of the link rate. 
■ 0 As discussed in "Window-based Error Recovery and Flow Control With a 

Slow Acknowledgment Channel: A Study of TCP/IP Performance", P roceedings o/ 
UFOCOHW, April ,0 97 by T.V. Lakshman « al. (Lakshman), me impact of 
asymmetry on TCP/IP performance can be characterized using an index called 
normalized bandwidth ratio (k) which is me ratio of raw bandwidths o„ bod, 
.5 directions to the ratio of packet sizes in both directions. When k is greater man one, 

the TCP throughput on the forward channel is n*trirt~i 

cnannei is restricted to a maximum of (forward 

channel bandwidth)*. In other wotds, if the reverse channel is saturared at k 
acknowledgements/second without any acknowledgement suppression, the forward 
channel can send « a rate of k packets per second (if the window is constant), or dse 

20 ""kpacke«spersecond ( assumi„g W „ P acke K arosen,foreveryAC K , Thiscan 
be generated into a mode, which is called the AMP mode, and can be used to guide 
•he study of bom unidirectional and bi-directiona, transfers. Other facto, like hi- 
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directional traffic (e.g., downloading a web page whi.e sending an email) or protocol 
overhead (e.g., PPPoE, PPTP, L2TP, ATM, etc.) will increase k and father aggravate 
the asymmetry problem. 

It has been shown in "The Effects of Asymmetry on TCP Perfonnance ». ACM 
5 Mobile Networks and Application Journal, by Balakrishnan et al. (to appear) and in 
U.S. Patent 5,5793,768 (Keshav), that performance can be substantially increased by 
making two key changes: simply suppressing acknowledgements on the reverse 
channel (ACK-filtering), and regenerating them after the reverse link has been - " - 
traversed (ACK-reconstruction). Balakrishnan et al. also apply the same techniques to 

10 address types of asymmetry other than bandwidth asymmetry, including asymmetry in 
delay, loss rates, and so on. These techniques can be classified as "ACK-regulation 
techniques" since they are very different from mechanisms like Random Early Drop 
(RED) because the latter are designed to drop packets, not ACKs, and are used to 
signal congestion to TCP, not to alleviate asymmetry problems. 

1 5 Balakrishnan et al. disclose an "ACK-filtering" method wherein when a new 

ACK enters the queue device, the queue is checked for previous ACKs from the same 
flow. If previous ACKs are located in the queue, some or all of the of the previous 
acknowledgments are cleared or discarded and the latest acknowledgment is enqueued 
at the tail of the queue. The goal is partially to free some space in the queue for other 
20 data packets and ACKs, and partially to compress the ACK information. There is no 
per-flow state, or multiple queues, but there is overhead in linearly searching the 
queue for ACKs. Balakrishnan et al. disclose that in some cases ACK filtering alone 
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provide, either insufficient compensation for asymmetry o, even degrades 
performance, necessitating the use of other techniques like ACK congestion control 
(ACQ, which involves TCP modification, ami/or ACKs-ftrst (priority, scheduling for 
compensation. This is because of the delays in sending out ACK infonnation which 
5 might interact with timeouts. 

Keshav discloses an "ACK-collapsing" method wherein all ACKs are 
enqueued, bu, a, the transmission oppottuniry, the ACK received la.es, in time is sen, 
and all otiter ACKs in me queue are dropped. Several ways of implementing dtis idea 
are possible (e.g., using separate ACK queues, or queueing ACKs in a LIFO manner, 
10 or with a single queue, searching the queue for the latest ACK when there is a 
transmission opportunity for the connection). 

Figure 1 shows a schematic block diagram of a conventional TCP network 
comprising an ADSL link 3 which is terminated on either end by a remote end ADSL 
transceiver unit (ATU-R) device 2 located a. a customer premises (e.g., a modem) and 
1 5 a central end ADSL transceiver unit (ATU-C) device 4 located at a telephone 

company centra, office. The ADSL link 3 has a bandwidth of 8 Mbps in the forward 
link, and 64 Kbps to 784 Kbps in the reverse link. The ATU-C device 4 functions are 
assumed to be implemented mside a DSL access multiplexer (DSLAM). Dam packed 
are transmitted from a TCP data source, such as the mteme. 6, using a network device 
20 or router 5. The router 5 transmits the dam packets to the ATU-C device (DSLAM) 
30 over a 155 Mbps link. The ATU-R device 2 is connected to a TCP destination or 
computer 1 via a ,0 Mbps switched Ethernet link. The interface to the computer 1 is 
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often though the point-to-point protocol over Ethernet (PPPoE) standard which allows 
the leverage of Ethernet boards which may be pre-installed in computers. Further, 
multiple computers 1 may be connected through the Ethernet to the ATU-R device 40. 
In the case of multiple TCP sources (not shown), each source would have a 
5 corresponding dedicated 1 0 Mbps link to the router 5. 

Several problems arise due to the constrained reverse link of the ADSL link. 
An example of this is a user downloading data from a server. To facilitate 
understanding of the problem, the following discussion is restricted to single source 
transfer with reference to Table 1 illustrating unidirectional single flow simulation. 
10 When the queue buffer size is infinite, the forward throughput is restricted to less then 
75o/„ of the full throughput Further, it can be seen that the effect of asymmetry 
decreases when the reverse link bandwidth is increased. TCP enters into the 
congestion avoidance stage in the time limit of 0 to 7 seconds. Moreover, TCP after 
some time of simulation apoint of saturation where the number of data packets 
1 5 generated in response to a single ACK is only two. 



TABLE 1 



Forward/Reverse 
Speeds 



Throughput 
(Mbps) 



Average 
Queue 



Simulation 
Time (seconds) 



8Mbps/64Kbps 



2.51 



8Mbps/l 28Kbps 
8Mbps/64Kbp7 



3.85 



0.03 
0.03 



1.52 
3.01 



_0_ 
0 



20 



8Mbps/128Kbps 



20 



8Mbps/256Kbps 
8Mbps/640KbpT 



5.98 
7.46 



0 



20 



1.25 
0.5 



20 



8Mbps/784Kbps 



7.46 



0.8 



20 



0.41 
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Therefore, it is an object of the present invention to solve the problem of 
forward throughput degradation associated with ADSL reverse link saturation. 

Summary of the Invention 
5 In accordance with the present invention, a communication method and system 

are provided for a TCP network having an ADSL link wherein acknowledgment 
packets (ACKs) are dropped at one end of an ADSL reverse link and are regenerated 
at the other end of the ADSL reverse link to increase throughput on both the ADSL- 
forward and reverse links. In particular, when an incoming ACK is received at an 
10 ATU-R device located at one end of the ADSL link, the ATU-R device determines 
whether a prior ACK from the same connection/flow (TCP receiver) is presently 
stored in a queue awaiting transmission. If a prior ACK packet is not presently stored 
in the queue, then the incoming ACK packet is stored in the queue for transmission to 
an ATU-C device located on the other end of the ADSL link. However, if there is a 

1 5 prior ACK packet in the queue, then the information contained in the incoming ACK 
packet (the ACK packet that is generated latest in time) is stored in a per-flow state 
table at the ATU-R device and the incoming ACK packet is discarded. When the 
prior ACK packet is ready to be transmitted to the ATU-C device via the ADSL link, 
the information contained in the per-connection state table regarding the discarded 

20 incoming ACK is copied into the prior ACK so that the prior ACK acknowledges all 
of the data which the discarded ACK should acknowledge. 



6 
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Upon receiving the prior ACK, (he ATU-C device may regenerate the 
discarded ACK based on the infotmation contained in Ore prior ACK such as Ore 
number of discarded ACK packers and a connection identifier encoded in a special 
field within the ACK. The ATU-C device also maintains a pet-connection sure .hie 
S which contains infotmation regarding the ia.es, ACK sequence number belonging to 
each connection. Further, a regeneration factor is introduced which denotes the 
number of discarded ACKs regenerated in response to one ACK. 

The preferted embodiment of the present invention has as its object the 
suppression of as many ACKs in me reverse channel as possible. In this manner, the 
■ 0 preferred embodiment of the present invention takes Mvmagt o{As &c , ^ JCf 
ACKs are cumulative and ensures an acknowledgment packet of a connection in the 
queue of the ATU-R device. An ACK whioh leaves fire queue acknow.edges all the 
date which the latest ACK coming into queue should acknowledge. Further, per- 

connection information is maintained so that it ttuarantee* „~ a rv 

11 guarantees one ACK per-connection to 

15 be sent back to the ATU-C device. As a result, a buffer size of only N ACKs is 
required where N is the number of active flows, assuming separate packet buffers. 

Brief Description of the Drawin gs 

A preferred embodiment of the present invention is described in detail below 
20 with reference to the attached drawing figures, in which: 

Figure 1 is a diagram illustrating a conventional TCP network; 
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Figure 2 is a flowchart illuming an ACK discarding method in accordance 
with the preferred embodiment of the present invention; 

Figure 3 illustrates the fotma. of an ACK packet and a TCP header; 

Figure 4 iHustrates the fonna, of a per-connection state table in accordance 
with the preferred embodiment of the present invention; and 

Figure 5 is a flowchart iUustrating an ACK regeneration method in accordance 
with a prefen-ed embodiment of the present invention. 



Detailed Description of the Preferred Emhndim m , 

Forward throughput for one-way transfer using TCP follows die "AMP" 
mode, where A is the ACK dismission re,., M is the multiplication factor (packets 
generated for each ACK received) and P is the ACK packet size. That is, the fraction 
of dte reverse link allocated to ACK traffic is sanrmted a, A ACKs/second, each ACK 
generates M packets on the average (M - multiplicative factor), due to the effects of 
TCP dynamics and ACK-regulation schemes working together, and the average size 
of packets is P bits/packet If the forward .ink capacity allocated to packets 
corresponding ,„ these ACKs is F bits/second, men the forward link throughput over 
the observation period is limited to MinfF, A-M-P, bits/second. Since the ACK rate 
A is fixed, the only variables arc M and packet size P. 

As discussed earlier, Lakshntan's normalized bandwidth ratio "k» 
characterizes an absolute upper bound on the forward throughput based upon ,mk 
bandwidths and packet vs. ACK sizes. Tbe AMP expression, on the other hand, is an 
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operational bound achievable with the asymmetric channel augmented with ACK- 
regulation schemes. In particular, if the ACK-regulation components can achieve a 
maximum average multiplicative factor of M, then the AMP expression is a tighter 
bound on the achievable forward throughput. Moreover, it also accounts for 
5 scheduling allocations to ACKs and corresponding packets and vice versa (in the 
definition of F and A), and can hence be useful in understanding effects of bi- 
directional traffic. 

For example, assuming that the reverse link speed is 64 kbps, the forward link 
speed is 8 Mbps (the forward link is fully allocated to carry packet traffic, and the 

1 0 reverse link to carry ACK traffic), packet size is 1 000 bytes, ACK size = 40 bytes, 
TCP is in its slow start phase (generating two packets per ACK) and no ACK- 
regulation schemes are used. The ACK rate (A) would be 200 ACKs/second , the 
multiplicative factor M=2, and P = 8000 bits, and the maximum throughput limit on 
the forward link = Min (8 Mbps, 3.2 Mbps) = 3.2 Mbps. It should be noted that the 

15 number of TCP flows sharing the ADSL link is immaterial in this model because it 
should be captured in the specification of M. In particular, in this case if the TCP 
sources are all in congestion avoidance (and not in slow start), then M is closer to 1, 
and limit is even lower (about 1 .6 Mbps). 

The AMP model is also useful in analyzing the bi-directional traffic case, 
20 especially when link-sharing schemes like class based queueing (CBQ) are deployed. 
Specifically, it can be assumed that in each direction, there are two classes (queues) 
served by CBQ: one for packets and one for ACKs. It is further assumed that packets 
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on the forward link get a fraction f (1 > f > 0 ) of the forw^H i v 

or the forward link capacity (C f ), and on 

the reverse link get a fraction g (1 > g > 0) of the reverse link capacity (C r ). Link 
capacities are expressed in bits/second. ACKs, therefore, get fractions 1-f and 1-g of 
the capacity of the forward and reverse links, respectively. Unused , 
class may be used by the other class. 



capacity of one 



He AMP mode! can be apphed ,o the system as fo„ows, assuming ma, P , is 
me size of ACKs in bi,s/ACK and for simp.ichy, tha, me reverse ehanne, (b o4 
packets and ACKs) is saturated at their . 



' respecttve scheduling shares. The bounds on 
the maximum rates of packets and ACKs in both directions 
10 table: 



are given in the following 



| l-orward Cha nnel" |Mml(l.g) C.M/Pack. fC./pT 

The reverse ACK rate is therefore (1 -g,. c r /Pack ACKs/s, which ca^ 
generate a maximum packet rate of Min[(l-g, c, M/Pack, «yp, in me forward 
15 direction. For the above saturatton assumption to hold, it is necessary tha, me forward 
packet rate is no, samra,ed, i.e., (,. g) c , M/Pack <= fC./P. Given ma, both M and g 
can v»y on me LHS of me inequahty, me ftacdon f s hou.d be se, large enough to 
accommodate the maximum of the pmduc. (M* (,-g),. Moreover, the maximum 
possible ACK rate on the forward channe, cotrespondmg to any packet rate on the 
20 reverse chamrel is expected to be small for any asymmehic channel. For example, 
even if the revere channe! is 640 kbps (k - 0.5) and a., of i, was al.oca.ed to packets. 
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the ACK rate on the forward channel is 25.6 kbps, less than 0.33% of an 8 Mbps 
forward link. Therefore, f (the link fraction allocated to packets on the forward link) 
should be chosen to be large, and can be as large as 99% for pure TCP/IP bi- 
directional traffic. 

5 The choice of g, however, is partly a policy issue regarding the minimum 

bandwidth provided to long flows, and partly a performance issue regarding the under 
utilization of the forward link capacity. If M could increase dynamically to perfectly 
compensate for the decrease in ACK rate A due to increase in reverse packet traffic, 
then the performance issue mentioned above disappears. However, M is limited 

10 primarily due to dynamics of TCP, especially congestion avoidance, even if ACK 
regulation schemes could dynamically adapt to increases in reverse packet traffic. In 
particular, if the normalized bandwidth ratio k, measured in terms of link shares of 
ACKs and packets on both directions, increases beyond 10, ACK regulation schemes 
cannot provide sufficient compensation. Therefore, the choice of g (the link fraction 

15 allocated to packets on the reverse link) is a tradeoff between performance and policy 
considerations. 

The preferred embodiment of the present invention seeks to suppress as many 
ACKs in the reverse channel as possible. In this manner, the preferred embodiment 
of the present invention ensures an ACK of a connection in the queue of the ATU-R 
20 device 2 and takes advantage of the fact that TCP ACKs are cumulative. An ACK 

packet which leaves the queue acknowledges all the data which the latest ACK packet 
coming into queue should acknowledge. Further, per-connection information is 
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maintained so that ■« guarantees one ACK per-connection to be sen, back to the other 
end of the ADSK link. 

In the preferred embodiment, when an incoming ACK from the TCP receiver 
is received at the ATU-R device 2, it is determined whether an ACK from the same 
5 connection or destination is presently stored in the queue awaiting transmission. A 
first-in-first-out (FIFO) queue is utilized for storing ACKs (and optionally packets, as 
discussed later). Unlike U.S. Patent No. 5,793,768 (Keshav), the preferred 
embodiment utilizes a minimal per-flow state to avoid enqueuing ACKs which are ~ 
going to be dropped anyway. In this manner, a queue size of only N ACKs is 
10 required, where N is the number of active flows/connections assuming separate packet 



buffers. 



In particular, with reference to Figure 2, when a data unit is received by the 
ATU-R device 2 from the TCP destination 1, the ATU-R device 2 first must 
determine whether the data unit is an ACK (step 1 1). If the incoming data unit is 

15 determined to be an ACK, the connection or session ID of the incoming ACK is then 
identified by checking the source port number, the destination port number, the source 
address and the destination address in a TCP header of the incoming ACK (step 12). 
Figure 3 illustrates the format of an ACK packet and a TCP header. The connection 
of the incoming ACK as identified by the TCP header is then used to determine if per- 

20 flow information regarding the connection of the ACK is stored in a hash or per- 
connection state table at the CPE device (step 13). As shown in Figure 4, the per- 
connection state table includes a flag consisting of a single per-flow or active bit 
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which indices if an ACK of that How exists in the queue, and the latest ACK 
sequence number seen from tha, flow. If the connection of the incoming ACK is 
represented in the per-connecion state table, me active hi, is checked ,o determine if a 
Prior ACK from the same destination is presently stored in .he queue (step 14). ,f me 
5 active hi, is zero, me ACK is stored in me queue, the active hi, is set ,o "1 » and the 
ACK sequence number is copied into die per-connection state table (step 17). If the 
active bit is already set upon receipt of a non-duplice ACK, men the ACK sequence 
number in me per-connection state .able is updated ,o mis value, me ACK is discarded 
, and an ACK drop coumer a, «he ATU-R device 2 is incremented <s.ep 16). On the 
10 other hand, if the connection of me ACK is no, represented in the P er-connec«io„ s,a.e 
table, a new entry is creared for me connection of me mcoming ACK which includes 
■he source port number, the destination port number, the source address and the 
destination address from me header of U,e incoming ACK (step 15). The ACK 
sequence number is dren copied into the per-connecion state .able, the active bi. is 
1 5 set, and die incoming ACK is stored in die queue (step 1 7). 

When an ACK is dequeued for .ransmission from die ATU-R device 2 ,o the 
ATU-C device 4 via me ADSL link 3, me la.es, value of ACK sequence number from 
me per-connecion suae table is copied ,o die header (header checksum adjusted) of 
me outgoing ACK and me number of ACKs being dropped as indicated by me ACK 
20 drop coumer is encoded into dte ACK header. Further, me active bi, in die per- 
connecion state table is cleared and die ACK drop coumer is reset. It should be noted 
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that ACK processing complexity is Of 1) since the h*ch ,,ki 

y ; since the hash table is searched rather than 

the FIFO queue. 

• I. is assumed tha, ACKs are n0 , dropped ^ ^ ^ ^ 

of dupHcate ACKS, *. exac, number „ f Ae d up,ica,e Acfc . ^ ^ ^ 

in a fas, recovery procedure. Therefore, mere are rwo options: either send the same 
numher of duphcare ACKs in me reverse channe,, or have a regeneration component 
which regenerates the correct number of dupiicate ACKs. To achieve the former goa! 
an addition*, fM can be provided h ^ ^ ^ ^ ^ ^ 

~rt.> which conn* me number of dupHcate ACKs ("dup-ACK count", „ hich have 
been suppressed. This aUows me Hgh, number of dupHcate ACKs to be transmitted. 
SpeciftcaHy, when an opportunity arises, a,, of the duplicate ACKs Utus encoded can 
be nansmitted before deoueueing me nex, ACK, and as each duphcate ACK is being 
emitted, the dup-ACK coun, in me tebl. can be decremented by one unu! it 
reaches zero. Note that mis ailows me dup-ACK coun, ,o increase even as duphcate 
ACKs are being —-tod. Toe per-flow bi, is se, ,o ze ro on,y after nansmirting ai. 
dupHcate ACKs. Aitemauveiy, if4 , number of dupHcate ACKs can be encoded 
inside some promco. header, men a componen, on me omer side of me .ink can 

regenerate the same number of duplicate ACK* «,,th™.. , 

upucare ACKs without needing them to be explicitly 

transmitted on the reverse channel. 

The AMP model discussed above, in conjunction with a knowledge of TCP 
dynamics, facilitates an understanding of the advantages of the present invention. If 
A and P i„ the AMP model are assumed to be constant, then the ACK dropping 
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method of the preferred embodiment impacts only M in the AMP model, and this 
effect is also highly dependent upon TCP dynamics. 

TCP uses an adaptive window to send packets into the network. If the window 
remained fixed, or changed very little (as in the TCP congestion avoidance phase), the 
5 forward throughput is almost constant at W/RTT, assuming RTT is constant. In this 
situation, suppose m ACKs (m < W) are suppressed for every ACK transmitted on 
the reverse channel (assuming every new ACK acknowledges one new segment). The 
source would receive one ACK for every m packets it transmitted, and transmit m 
packets for every ACK received. But since the window is fixed, the transmission rate 

10 would not exceed W/RTT. Therefore, the impact of the ACK discarding method of 
the preferred embodiment is to use the reverse channel capacity of A ACKs/s to 
support a maximum forward rate (as given by the AMP model) of Min[m*A, W/RTT] 
packets/s. Note, that since TCP increases the window by 1/Wper ACK received 
during congestion avoidance, the window increase during an RTT is 1/m, because the 

1 5 number of ACKs per-RTT has reduced from W to W/m. 

When the contending TCP flows are all in the slow start phase, each ACK 
reaching the 

TCP source results in (m + 1) segments being sent, where m is the number of ACKs 
suppressed. This is because TCP sends one new packet for every segment 
20 acknowledged (m segments are acknowledged in this case) and one additional new 
packet for increasing the window by one segment. If m is a constant, the 
instantaneous maximum forward rate (as given by the AMP model) is Min[(m + 1)*A, 
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W/RTT, packets/s, where W is a!so a variable. to reafiry, m is . ^ ^ 
IniUafiy, m is ^ because .here are no, many ACKs ,o suppress. Later m can be 

,arge depending upon W, and provided Ore flows regain in siow „ Note 
to, since TCP increases the window by one segment for every ACK received, the 
rare of increase of TCP windows is reduced fiom doubling per RTT (facror of 2) ,o a 
factor of (, ♦ W(m, per RTT. because Ore number of ACKs per RTT has reduced fiom 



W to W/m. 



Referring back at the AMP model, the multiplicative factor M cat, be closely 
approximated as the mean of instantaneous values of (m +1 ) during slow start, and 
10 values of m during congestion avoidance or constant window. In fact, if the TCP 
sources system remains in slow star, phase, the AMP model predicts that the ACK 
discarding method of the preferred embodhnem can compensate for arbitrary degrees 
of asymmetry (i.e. any finite k). However, since most TCPs reach congestion 
avoidance within a few RTTs, me multipUcative .actor satura.es « the value of (near- 
.5 constant, m seen during the congestion avoidance. In other words, any measurement 
sample of m (number of ACKs suppressed per ACK transmuted) during congestion 
avoidance phase wil. be a good upper bound of M for me entire observation period. 
This also imphes mat a higher initial value of SSTHRESH can lead to a higher M 
because the system saturates a, a higher window (and m, value. Alternatively, if 
20 SSTHRESH (or socket buffer size, is small then they have the most dominant effect 
on performance because M saturates. 
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Further, the probability of negative interactions with RTT estimation is greatly 
reduced compared to the ACK-filtenng method Balakrishnan et al. for two reasons. 
First, negative interactions with TCP timeouts occur when there is a possibility of 
unbounded or large queueing delays compared to the TCP source's current estimate of 
5 RTT. Second, the ACK dropping method of the preferred embodiment bounds the 
maximum queueing delay (time between enqueue and dequeue of any particular 
ACK) at the controlled queue to be N/A seconds, where N is number of contending 
flows and A is the ACK transmission rate in units of ACKs/second. There will be a 
low probability of negative interactions as long as N/A is relatively small compared 
10 to the smallest RTT estimate of the source. 

Besides the positive effects of reduced ACK buffer size on the reverse link, 
and increased M in the AMP model, the ACK dropping method of the preferred 
embodiment also has negative effects, some of which can be compensated for. First, 
the suppression of ACKs causes a burst of m (or m+1) packets to be sent to the TCPs 
1 5 for every ACK. The variation in m determines the maximum queue size on the 

forward direction. However, a reasonable buffer size can compensate for this and is 
recommended to avoid interactions due to packet losses. Secondly, the rate of increase 
of TCP window size is limited to factors of (1+ W/m) and (1+ 1/m) during slow start 
and congestion avoidance, respectively (as measured over an RTT). Further, the ACK 
20 dropping method of the preferred embodiment requires access to write TCP headers 
and cannot work under IPSec authentication/encryption, whereas the other schemes 
(eg., Keshav and Balakrishnan et al.) can function under authentication, but not 



1* 



BNSDOCID^WO 0131833A1 l_> 



WO 01/31833 

PCT/I LOO/00684 

dropping method ofAs prefemd embodjment ^ to ^ ^ ^ 
during enqueue ,„ d dequeue wherMs ^ me(hods ^ ^ 

Balaknshnan et al. schemes rem.irA a 

emes req ui re ACK processing during only one of these 

5 operations. 

H- burstiness ^ window „ _ ^ ^ ^ ^ ^ 
acknowledge, regenera^™^ (AR) ^ ^ ^ ^ ^ 

ACKs suppressed at the ATU-R device. b fact , me ^ ^ 

10 ^e than one ACK per maximum segm ent si Z e (MSS), which can be quantified as 

the "regeneration factor" R, all the way up to one ACK for 

y "P to one ACK for every byte acknowledged 

The rate of TCP window increase for a round trip time CRTK ■ 

P tune (RTD is now modified to a 

factor of Min(l+R, i +W / m ) during slow start anH , € ♦ * 

) unng siow start and a factor of (1+R/W) during 

congestion avoidance, at the cost of (R-i)* W excess AC*:* x>^ 

XCCSS ACKs P er RTT. Given this huge 

noted tha, „ ta system ^ ^ to cMgestjon avojdanM ^ ^ ^ 

- - .c increase b y a factor of (I +R/W) every RTT jf r b ^ . ^ 

W, AR has only . ^ ^ ^ in compcnsMing ^ ^ ^ 

words, the ACK dropping met h„d of the preferred emlwf 

me pretemd embodiment should be viewed as 

^Pri^asymmeoy compensation technique. 

The ACK regeneration method of the prefer embodiment of the ptcsen, 

mvention win be described with referent t0 Fjgure 5 When an ACfc " • 

5 * c j. wnen an ACK is received by 
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the ATU-C device 4 via the ADSL link 2, the ATU-C device 4 may regenerate the 
discarded ACK(s) based on the information contained in the (prior) ACK packet and a 
per-flow state table maintained at the ATU-C device 4. The per-connection state 
table at the ATU-C device 4 is similar to that of the ATU-R device 2 except that it 
5 comprises a field for storing the latest ACK sequence number in place of the active 
bit. In particular, if it is determined that a received data unit is an incoming ACK, the 
ATU-C device 4 decodes the TCP header of the incoming ACK to determine the 
connection or session ID of the incoming ACK by checking the source port number, 
the destination port number, the source address and the destination address in the TCP 
10 header of the incoming ACK, and the number of ACKs discarded at the ATU-R 
device 2 (steps 21 and 22). The ACK sequence number in the TCP header of the 
incoming ACK is copied into the latest ACK sequence number field of the per- 
connection state table (step 23). If the connection of the incoming ACK is 
represented in the per-connection state table, then the ATU-C device 4 determines the 
15 number of ACKs to be regenerated based on the latest ACK sequence number stored 
in the state table and the number of ACKs dropped at the ATU-R device 2 stored in 
the header of the incoming ACK (step 25). The discarded ACKs as well as the 
incoming ACK are then regenerated and transmitted to the downstream node and the 
incoming ACK is discarded (step 27). If the connection of the incoming ACK is not 
20 represented in the state table, a new entry is created wherein the connection identifier 
information and ACK sequence number are recorded and the incoming ACK is 
transmitted to the downstream node (step 26). Further, a regeneration factor is 
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which denotes , h e number of discaried ACfa regenemed ^ responM o 
one received ACK. 

Stations have shown fa, te foiw ^ throughpm ^ ^ 

— in the region fcctor bu, tha, it reaches . maximun , ^ ^ ^ 
5 regeneration factor is <«. Any ft[ther facrease „ ^ ^ . ^ 

helpful. The ease when generation factor is one means the number of ACKs 
topped are regenerated. The throughput achieved by using ACK reg=„era ti o„ in 
conjunction with the ACK discarding method of .he preferred embodiment differs 
from the throughput achieved by me ACK discarding method of the preferred 
■0 embodtmen, alone because of me difference in the number of ACKs reaching the 
source. The window available for me source to send the data is more in case of me 
regeneration factor-, then of the ACK discarding preferred embodiment of the 
present invention. 

Ahhough the present invention has been shown and described with respect ,o 
1 5 preferred embodiment, various changes and modifications within the scope of me 
invention will readily occur to those skilled in the art. 
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What is claimed is: 

1 • A method of communicating acknowledgment packets over an 
asymmetrical digital subscriber line, comprising: 
5 generating a plurality of acknowledgment packets at a destination node 

response to receiving data generated by a source node; 

sequentially transmitting said acknowledgment packets from said destination 

node; 

receiving a first one of said acknowledgment packets at a first intermediate 

1 0 node; 

storing said first one of said acknowledgment packets in a queue at said first 
intermediate node; 

receiving a second one of said acknowledgment packets at said first 
intermediate node while said first one of said acknowledgment packets is stored in 
1 5 said queue; 

copying information contained in said second one of said acknowledgment 
packets into a data table at said first intermediate node; 

discarding said second one of said acknowledgment packets at said first 
intermediate node; and 

20 copying said information contained in said second one of said 

acknowledgment packets data from said data table into said first one of said 
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acknowtedgmen, packets and tx^smitttog said fim one of said acknowledge, 
packets from said first intermediate node. 



2: The method according to claim 1, further comprising the steps of: 
receiving said first one of said acknowledgment packets at a second 
intermediate node (DSLAM); 

regenerating said second one of said acknowledgment packets based on said 
information copied into said first one of said packets a, said second intennediate node; 
and 

sequentially transmitting said firs, one of said acknowledgment packets and 
said second one of said acknowledgment packets from said second intermediate node 
to said source node. 



3. The method according to claim 1, wherein said information copied into 
15 said first one of said acknowledgment packets comprises the number of 

acknowledgment packets dropped at said first intermediate node and a connection 
identifier. 

4. The method according to claim 2, wherein said regenerating step 

20 further comprises generating a new acknowledgment packet which replaces said first 
one of said acknowledgment packets. 
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5. A method of communicating acknowledgment packets over an 
asymmetrical digital subscriber line comprising: 

• (a) generating and transmitting a first acknowledgment packet from a 
destination node in response to receiving data generated by a source node; 
5 (b) receiving said first acknowledgment packet at a first intermediate node; 

(c) determining whether a second acknowledgment packet previously 
received from said destination node is presently stored in a queue at said first 
intermediate node; 

(d) storing said first acknowledgment packet in said queue if said second 
1 0 acknowledgment packet is not stored in said queue; 

(e) copying information contained in said first acknowledgment packet 
into a state table and discarding said first acknowledgment packet at said first 
intermediate node if said second acknowledgment packet is stored in said queue; and 

(f) copying said information contained in said first acknowledgment 

15 packet from said state table into said second acknowledgment packet and transmitting 
said second acknowledgment packet from said first intermediate node. 



6. The method according to claim 5, wherein step (c) further comprises 
determining connection information regarding a source and a destination of said first 
20 acknowledgment packet from a header of said first acknowledgment packet. 
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7- The method according to data 6, wherein step (c) further comprises 
derertntahg whether flag is se, b said state labk „ ^ fa( ^ ^ ^ 

flag indicating „ hether . prior acknow.edgmen, p ^ ^ ^ ^ 

connection is prese„ tly stored in said queue awainng Emission from ^ ^ 
5 intermediate node. 



8. The method aceording to data 6, wherein step (d) further comprises 
copying an ACK sequence number stored in said header of said fust acknowiedgm. 



10 



15 



20 



lent 

into said state table. 



9. The method according to data 4, wherein step (e) further comprises 
the steps of: 

receiving said second actaowiedgment packet a, a second intermediate node; 

and 

regenerating said firs, acknowiedgmen, packet based on said information 
copied into said second acknow.edgmen, packet a, said second intermediate node. 

10. The method according to claim 9, wherein sup <e> further comprises 
the steps of: 

generating a third acknowiedgmen. packet which replaces said second 
acknow,edgmen, packet and discarding said second acknow.edgmen. packet a, said 
second intermediate node; 
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transmitting said first and third acknowledgment packets from said second 
intermediate node. 

1 1 - The method according to claim 4, wherein in said queue comprises a 
5 first-in-first-out (FIFO) buffer memory. 



an 



12. A communications apparatus for transmitting data over i 
asymmetrical communications link, the apparatus comprising: 

a source node for generating and transmitting a plurality of data packets; 
10 a first intermediate node for receiving said data packets from said source node 

and transmitting said data packets over an asymmetrical communications link; 

a second intermediate node for receiving said data packets from said first 
intermediate node and transmitting said data packets, said second intermediate node 
comprising a queue and a state table; and 
1 5 a destination node for receiving said data packets from said second 

intermediate node and generating a plurality of acknowledgment packets in response 
to receiving said data packets transmitted by a source node; 

said second intermediate node receiving said acknowledgment packets, storing 
said acknowledgment packets in said queue and transmitting said acknowledgment 
20 packets stored in said queue, wherein each time said second intermediate receives one 
of said acknowledgement packets, said second intermediate node stores said one of 
said acknowledgment packets in said queue if a prior one of said acknowledgment 
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is not presently stored h £ajd ^ copiM tofoima[ion ^ ^ ^ 
one of said acknowiedsmen. packe|s ^ MW _ ^ ^ ^ ^ ^ ^ 

presently stored in said queue. 



•3. The apparatus according „ claim ^ ^ ^ ^ 

node copies said information contained in said one of said one of said 
actaowiedgmen, pae.ce. from M satt ^ ^ ^ ^ ^ ^ 

acknowiedgmen, packets and transmits said prior _ „ f ^ 
packets. 



14. The appamhts according to Cairn ,3, wherein said firs, intermediates 
node receives said newsmen, packets from said second intermediate node and 
regenerates said acknowiedgmen, packets which where discarded by said second 
tntermediate node hased on said information copied into said acknowiedgmen, 
packets from said state tabic by said second intermediate node. 

•* The apparatus according ,„ Cairn ,2, wherein in said q ue„e comprises 
a first-tn-first-out (FIFO) buffer memory. 
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FIGURE 2 



Is received data unit an 
acknowledgment packet (ACK)? 



W 



Identify the connection (session ID) of 
ACK from TCP header 



Determine if connection (session ID) 
is in state table 


HO 


ves. 


Is Active flag set? 


Create new entry in state table 
for this session 





(1) Copy ACK number field in TCP header 
into state table 

(2) Discard ACK 

(3) Increment ACK drop counter 



i 1 



(1) Copy ACK number field in TCP 
header into state table 

(2) Set Active flag 

(3) Enqueue ACK 
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FIGURE 3 



ACKNOWLEDGMENT PACKET FORMAT 



IP HEADER 



TCP HEADER 
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FIGURE 4 
Per-Connection State Table Format 
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FIGURE 5 
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Is received data unit an 
incoming ACK? 
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Determine connection (session-ID) and number <7 
acks dropped from TCP header of i„c 0m Tng ack 
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Copy ack sequence number in TCP * — T~ 

sequence number field of stateable *** mt ° ^ ack 
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Is connection in state table? 



(O Determine latest ack number from hash 

(2) Determine number acks to be 
regenerated 



(1) Regenerate discarded acks and 
incoming ack 

(2) Discard incoming ack 

(3) Transmit regenerated acks to 
downstream node 
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«n hash table 

(2) Copy connection id and ack 
number from TCP header of 
incoming ack into the state table 

(3) Transmit incoming ack to 
downstream node 
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